This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 



BEST AVAILABLE IMAGES 



Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 



BLACK BORDERS 

TEXT CUT OFF AT TOP, BOTTOM OR SIDES 
FADED TEXT 
ILLEGIBLE TEXT 
SKEWED/SLANTED IMAGES 
COLORED PHOTOS 

BLACK OR VERY BLACK AND WHITE DARK PHOTOS 
GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 



MflR-01-2004 18:32 FROM: 



416 601 8200 2911 TO : 9 1 7034 1 52559 



CO 

^= ro 



IMAGE REGION SEGMENTATION SYSTEM AND METHOD 

The present invention relates to the field of imaging and in particular to i 
system and method for segmenting certain subsets of images in order to isolate^ 
specific structures. 

5 BACKGROUND OF THE INVENTION j 

In the field of imaging, and more particularly medical imaging, image, region 
segmentation methods are used to isolate subsets of an image corresponding to 
specific objects such as an artery, the heart, kidneys or any other such anatomical 
structure. These images may be obtained by various means such as, for example^ 

10 Magnetic Resonance Imaging (MRI), Computerized Tomography (CT) or any other 
such medical imaging system. Segmentation, or feature extraction, is an importanjt 
requirement for any medical imaging application. When a radiologist or a physiciarji 
looks at an image obtained from a medical imaging system, such as from an MRI, CT 
or any other similar system, he or she mentally isolates the structure relevant to the 

15 desired diagnosis. If the structure has to be measured or visualized by the computeij, 
the radiologist or physician has to identify the structure on the original images using f 
computer and program. 



There are two major classes of region segmentation methods. The first 
class of region segmentation methods is binary segmentation. Binary segmentation 
20 determines for every voxel in the image, using a, specific property or function and 
threshold values, whether or not that point belongs to an anatomical structure. The 
second class of region segmentation methods, gray-level segmentation, determines 
for every voxel in the image, using a specific property or function, the level of 
confidence" for which that point belongs to an anatomical structure. j 

25 Gray-level segmentation methods have the advantage of avoiding a priori 

knowledge of the threshold values by creating a "connectivity map" or membership 
that associates a level of confidence to each voxel, creating a number of solutions 

i 

that depend on the minimal level of confidence desired. The user can then simply set 
the threshold for the minimal level of confidence of the voxels to be displayed and 

1 
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can interactively raise or lower the threshold according to the obtained image. 

| 

There are, however, situations in which current gray-level segmentation 
methods are not optimal. For instance, when trying to segment a large blood vessel| 
the algorithm will segment the vessel only partially and include some bone structure 

5 because its density is very close to the density of the large blood vessel' 
Furthermore, gray-level segmentation algorithms using fuzzy logic base the 
membership values purely on the density of the image voxels and the connectedness 
to the seed point. Accordingly, a voxel who's density is identical to the seed point and 
to which there is a direct path from the seed point, such as for example an Arterio!- 

10 Venous Malformation, will have a very high membership value. This characteristic 
makes it difficult to properly segment the desired structure where distinct structures 
with similar densities exist. 

It is the object of the present invention to provide a system and method 
which obviates or mitigates the abovementioned disadvantages. j 

i 

15 In accordance with the invention, there is provided a method of segmenting an imag<5 
of a structure stored as a set of spatially related data points representing variations in 
a predetermined parameter, said method comprising the steps of selecting a seed 
point within the structure to be segmented, assigning to each of the data points a 
value of connectivity indicative of the confidence that respective areas of the data 

20 points are part of the same structure as said see point, said value of connectivity 
including a function of the distance of the respective point from said seed point, 
establishing a threshold value for said level of connectivity and selecting for displajy 
data points meeting said threshold value. 

Embodiments of the invention will now be described by way of example only with 
25 reference to the accompanying drawings in which: 

FIG. 1 is a schematic diagram depicting the components of an imaging 

system. 

FIG. 2 Is a schematic diagram depicting a j stack of cross-sections forming a ! 
three-dimensional array of voxels. 

i 
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FIG. 3 illustrates a generalized flow chart of an image segmentation 
algorithm. 

FIG. 4 illustrates a generalized flow chart of an algorithm to determine the 
connectivity of two voxels. 

5 FIG. 5 illustrates the results of a segmentation algorithm applied to an MRA 

image using a first parameter. i 

i 

FIG. 6 illustrates the results of a segmentation algorithm applied to an MRA j 
image using a second parameter. j 

FIG. 7 illustrates the results of a segmentation algorithm applied to an MRA j 
10 image using a third parameter. 

FIG. 8 illustrates a generalized flow chart of an algorithm the connectivity 
map browsing process. 

FIG. 9 is a schematic diagram depicting three different segmentation 
solutions, each representing a set of voxels having a predetermined minimal 
15 connectivity value. 

FIG. 10 illustrates the effect of the rising threshold value on the \ 
segmentation solutions of an MRA image. j 

FIG. 11 illustrates the effect of the rising threshold value on the j 
segmentation solutions of an MRA image. 

! 

20 FIG. 12 illustrates the effect of the rising threshold value on the 

segmentation solutions of an MRA image. 

FIG. 13 illustrates a generalized flow chart of an algorithm the contrast table 
setting and remapping process. 

FIG. 14 illustrates a generalized flow chart of an algorithm the density range 
25 setting and remapping process 
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FIG. 1 5 shows a histogram of the volume of a segmented structure in 
function of the connectivity threshold value. 

FIG. 16 illustrates a generalized flow chart of an algorithm the automatic 
threshold setting process 

5 FIG. 17 illustrates a generalized flow chart of an algorithm the image 

segmentation algorithm according to the present invention. I 

DETAILED DESCRIPTION OF THE INVENTION 

Referring to FIG.1, a system for acquiring the image data of a subject;, 
segmenting anatomical structures from the image data and displaying suctji 
10 structures, is indicated generally at numeral 10. Although the embodiment is 
described with reference to the segmentation of anatomical structures from images 
obtained by medical imaging systems, it may also be applied to the segmentation of 
other types of structures from images other than from such systems, such as from, 
for example, geological survey imaging systems. 

15 Turning back to FIG. 1, the system 10 comprises a medical imaging system 

12 to interrogate a patient and supply data to a computer 20 from which an image 
can be created. The data is stored as a set of spatially related data points 
representing variations in a predetermined parameter Each data point will include 
information about one or more predetermined parameters than can be displayed to 

20 illustrate variations in the parameters. The predetermined parameter is typically the 
density of the anatomical structure being imaged and can be displayed as variations 
in color or gray scale. The computer 20 include? a program 30 for running on this 
computer, and to manipulate and display the data obtained from the imaging system. 
The program 30 comprises a set of machine readable instructions, which may bp 

25 stored on a computer readable medium. Such a medium may include hardware 
and/or software such as, by way of example onCy, magnetic disks, magnetic tape, 
optically readable medium such as CD ROM's, and semi-conductor memory such as 
PCMCIA cards. In each case, the medium may take the form of a portable item such 
as a small disk, floppy diskette, cassette, or it may take the form of a relatively large 

i 

I 
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or immobile item such as hard disk drive, solid state memory card, or RAM providec 
in the computer 20. It should be noted that the above listed example mediums can 
be used either alone or in combination. 

The data and resultant images are stored on a database 22 and accessec 
5 via a user interface 24, such as a keyboard, mouse, or other suitable devices, for 
display on a display 26. If the display 26 is touch sensitive, then the display 26 itself 
can be employed as the user interface 24. Usually, : during an imaging procedure, the 
medical imaging system 12 scans a patient, producing a series of cross-sectionajl 
images (or slices) of the patient's body. These cross-sectional images composed of 
10 pixels, each having a measurable predetermined parameter, typically a density valuej 
are then forwarded to the computer 20. The program 30 stacks the data in a threej- 
dimensional array of voxels creating a three-dimensional image of the patient for 
viewing as a displayed image on display 26 and storing as a data-set 28 in the 
database 22. A voxel, or volume pixel, is spatial element defined as the smallesjt 
15 distinguishable part of a three-dimensional image. The user interface 24 provides 
facility for an operator to interact with the system, and more particularly, for selecting 
areas of the display image 26 for identifying structures to be processed or to set 

various parameters of the system. j 

j 

The computer 20 uses program 30 to processes the data-set 28 to produce 
20 the required image in a manner, which is described in more detail below. 

As shown in FIG. 2, typically each image: is comprised of a stack of cross- 
sectional images forming a three-dimensional array made up of individual voxels y, 
which is stored as a data-set 28 in the database 22. The program 30 includes a 
segmentation algorithm shown schematically in FIG. 3 which takes at block 102 thp 

25 three-dimensional array as input and at block 104 selects one or more seed points, s, 
located in the structure of interest. The seed point s may be an individual voxel but 
more generally is an initial location selected in the data-set in a convenient manner. 
The initial locations are usually selected and entered into the system by the user 
using the user interface 24 to view the overall structure and select the area of 

30 interest. Alternatively, the initial location may be selected semi-automatically (in 
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which there is minimal user interaction with the system) or even automatically (with 
no user interaction with the system) within the data-set that can be identified b>j 
computer processing employed on data representing the image. Such data may have 
characteristics that can be interpreted as a particular feature, for example data 
5 characteristic of a certain material type (for example bone in CT) or a boundary 
between two types of material, and thereby be used to select an initial location within 
the dataset without user intervention. 

The initial location may also be selected fr6m examination of other images or 
data-sets related in some manner (for example by correlation in space or time) to the 

10 one being examined which then permits the corresponding location to be identified 
on the image. Such images or data-sets could result from many sources, for 
example, from a different imaging modality (for example, a PET scan of the same 
patient correlated to a CT scan of that patient, or from MRI scan correlated to aip 
Ultrasound dataset) or from an atlas (for example anatomical or functional) that has 

15 been related to the dataset. Such images or datasets do not need to be the same 
dimensionality as the dataset being segmented (for example, two projection X-rays 

i. 

could be employed to identify an initial location on a four-dimensional cardiac CT 
dataset). j 

- ( 

i 

The segmentation algorithm is not limited to three-dimensional data. It can 
20 be applied to any multi-modality (that is having a dimensionality greater than one) 
images or data-sets. For example a four-dimensional dataset can be segmented by a 
logical extension of the segmentation algorithm. The most usual method of such 
extension would be to consider the four-dimensional dataset as a collection of three- 
dimensional datasets (taking the fourth dimension as the index into this collection of 
25 three-dimensional datasets) to which the segmentation algorithm could directly apply. 
However, more generally, the segmentation algorithm would be modified to directly 
operate on all dimensions of the multi-dimensional dataset. j 

At block 106 or each voxel v in the array, the algorithm calculates the "level 

of confidence" with which this voxel belongs to the same structure identified by the 

» 

30 seed points. The "confidence level" is defined as the connectivity from a specific 
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voxel to a seed point, which is a function in the variation of the predetermined 
characteristic along a path P(v, s) from the seed point s to the voxel v. Accordingly a 
path P(v, s) is selected from the seed point s to the voxel v and the variation of 
predetermined characteristic for each voxel along that path determined. As will be 

5 described below, this variation is used to assign a value of connectivity to the voxel v. 
Once all the voxels in the data have an assigned value of connectivity, at block 108 
the image may be segmented by selecting voxels with a required degree ofj 
connectivity, ie, a required level of confidence that the voxels belongs to the same 
structure as the seed point s. That level may be adjusted through interface 24 to| 

10 refine the image which, at block 110. is displayed in display 26. 

The connectivity may be determined in a number of different manners but aj 
particularly beneficial one is to determine it mathematically using fuzzy logic; 
concepts. If the characteristic function |i(v) over a fuzzy space, here the three-: 
dimensional array of voxels v composing the image being segmented, assigns for the 
15 predetermined characteristic of each element v a real value ranging in the intefvaj 
[0.1] and the path P(v, s) is a connected sequence of points from a voxel v to a voxel 
s, then the conventional fuzzy degree of connectedness C from v to s is expressed 

j 

as follows: \ 

i 

C „( v, s ) = max P( v. s) [ min pe P( v. a) M] Equation 1 

20 where C „( v, s ) denotes the degree of connectedness, or connectivity, 

between v and s over characteristic function n and P(v, s) is a path fron) 
v to s. | 

Thus the connectivity C is determined as the maximum of the minimum 
values of the predetermined characteristic in respective paths between the seed 
25 points and the voxel v. 

Applying the classical fuzzy definition to a modified field with respect to a 
seed point s is results in: 

» 

X s = 1-fo(v)-T,(s)| Equation 2 
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where (X fi ~ (x s (v)} ) is the fuzzy field space and n(v) denotes the fuzzy field 
equivalent to the stored image. 

I 
i 

Using this relationship, the connectivity can be expressed as: 
C x , =conn(X $ ,v,s) = maXp (va) [min pd p (VB) X s (p)] 

5 =1-min P(Vi , ) [max pcP(VB) |T,(p)-ii(s)|] Equation 3 

; j 

If v|(v) is the density, the density being expressed as a value in the interval; 
[0, 1], of voxel v, then the definition of connectivity from a voxel v to a seed point sj 
expressed by Equation 3 becomes: 

C x . =conrXX^,s) = 1-min R ^ Equation 4 

10 Equation 4 bases the connectivity purely on the changes in density of the! 

image voxels and the connectedness to the seed point Thus a voxel whose density 
is identical to the seed point and to which there is a direct path from the seed point; 
such as for example an Arterio-Venous Malformation (AVM) T will have a very higK 
membership value. However, where a voxel is remote from the seed point, the" 

15 Applicants have recognized that the confidence level should be lower due to the path) 
length from the seed point. 

Accordingly to facilitate segmentation of such structures, it is desirable to be 
able to reduce the connectivity value of any voxel proportionately to its distance from 
the seed point along the path between them. j 

! 

20 In order to take the path distance into account, the modified fuzzy field 

expressed in Equation 2, is modified so that it includes a function of the path distance 
from the seed point to the voxel. Equation 2 may be expressed as: 

X s = 1 - [|n(v) ~ r|(s)| + otA(v,s)]clipped in [0,1] Equation 5 

where a belongs to the interval [0,1) and aidenotes the relative weight of the 
25 path distance in the equation and A(v, s) denotes the path distance 

8 
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from voxel v to seed s, i.e. the number of voxels comprising the path. 

: 

Thus when considering modified fuzzy field expressed by Equation 5, the 
definition of connectivity expressed by Equation 3. becomes: 

t 

C x . = 1-min P(u ,„ [max pcP(Vie) [density (p)-density(s)| + a-A(p,s)]] Equation 6 

5 The connectivity C can thus be determined by obtaining at each voxel along 

a path the difference in the predetermined parameter, e.g. density, and combining 
this value with the function of the path length. The maximum combined values for i 
given path is selected and then the minimum of those values for the set of paths, 
investigated between two points is selected for subtracting from unity so that the 

10 value is lowest when the measured values are highest. j 

j 

Thus it will be seen that for two voxels with the same density, the 
connectivity of the one closest to the seed point wili be greater. 

To give the algorithm more flexibility, the user may set the value of a (i.e. the 
weighting given to the path distance) via the user interface 24. Accordingly, by setting 
15 a to 0, the connectivity expressed by Equation 6 becomes equivalent to Equation 3 
and the algorithm functions without considering path distance. However, by 
increasing the value of a, the effect of the relative densities is reduced and increasing 
importance is given to the path distance between voxel v and seed s. 

Adjustment of the value of a can significantly improve the segmentation of 
20 the image, especially in the case of structures that exhibit a large density range and 
therefore require a lower confidence level in order to be displayed as part of th.e 
structure. An increase in the value of a will have the effect of lowering the 
connectivity value progressively from the seed point and therefore excluding remote 
structures whose densities are within the range exhibited by the structure. Thus 
25 enhances the segmentation of such structures which are connected. 

The algorithm to obtain the connectivity of a voxel to a seed point is depicted 
by the flow chart shown in FIG. 4. The sequence of steps composing the algorithm: is 

9 
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indicated by the sequence of blocks 202 to 210. In block 202 the algorithm starts by 
selecting an unvisited path from the seed point to the voxel. The selection of a path 
may be performed by any suitable algorithm although the algorithm described by 
Dellepiane et al. in "Nonlinear Image Labeling for Multivalued Segmentation", IEEE 
5 Transactions on Image Processing, Vol. 5, No. 3 : , March 1996, pp. 429-446, has 
been found to be particularly useful. 

At block 204 f the algorithm labels the selected path with the maximum sum 
of the difference in density and weighted path distance between the voxel and thej 
seed point for all voxels in the path. It uses the selected value of a in the! 
10 computation to obtain the label. If the value of a is changed, the procedure isj 
restarted. 

At block 206 the algorithm determines whether all paths from the seed poin 
to the voxel have been considered. If not the algorithm returns to block 202 in ordeij 
to select another path. When all the paths have been visited the algorithm then 

15 proceeds to block 208 where the path with the minimum label value is selected 
Finally, at block 210 the connectivity between the voxel and the seed point is set as 
1.0 minus the label value of the selected path in block 208. It should be noted that 
the algorithm returns a connectivity value in the [0,1] interval but other scales may be 
used as well. For multiple seeds, block 204 may use. for example, the average 

20 density of the seed points, the density of the seed point with the density closest to the 
density of the voxel or the density of the seed point closest to the voxel. The 
algorithm depicted by blocks 202 to 210 produces an output array which is called the 
"connectivity map". . 

FIG. 5 shows an image of an AVM in which the vessel structure identified by 

L 

25 numeral 402 is to be segmented by selecting seedl point 401 located in the center of 
the structure. However, since the AVM 406 and other related vessels such as vessel 
structure 404 have the same density as vessel: structure 402, their connectivity 
values will be very high and thus remain associated with vessel structure 402. The 
effect of incorporating the distance function may be seen in FIGS 6 and 7, where the 

30 connectivity function for the labeling step of block 204, as expressed by Equation isj, 

10 

i 

I 
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is used to compensate for the path distance from seed point 401 . 

FIGS 6 and 7 illustrate the effect of different values of a. In FIG. 6, a first 

i 

increase in the value of a from that of figure 5 has the effect of diminishing of the 
connectivity value of vessel structure 404 and AVM 406, A further increase in the 
5 value of a is shown in FIG. 7 where the desired vessel 402 has been properly 
segmented. This results from the fact that Equation 6 causes voxels with the same 
density as seed point 401, but further away in the anatomical structure, to have lower 
connectivity values and, hence, exclude them from the segmentation as the threshold; 
is adjusted. 

10 The connectivity map resulting from the application of the algorithm 

described above represents not just one but a set of solutions, each with a different 
associated minimal level of confidence C x . . As the value of connectedness is varied, 
so the number of voxels included in the image will vary to permit refinement of the 
image or display 26. Using the connectivity map, the user can easily browse thrcug ji 

15 the set of solutions using display 26 and, using user Interface 24, select the one that 
best describes the desired anatomical region. In FIG. 8 there is shown a flow chaijt 
that depicts the browsing process steps. The sequences of steps performed is 
indicated by the sequence of blocks 222 to 226. In block 222 the user sets the 
connectivity threshold value via user interface 24 and in block 224 the voxels 

20 satisfying the criteria are retrieved from the database and the resultant image is 
displayed on display 26. In block 226 the user analyses the image displayed at block 
224 decides if it is satisfactory. If the image is not satisfactory, the user returns to 
block 222 and selects a new connectivity threshold! value. i 

By increasing the threshold, the user removes irrelevant structures and 
25 refines the anatomical structure where the seed point was planted. The labels of 
connectedness applied to the voxel are used as the different images are browsed. As 
can be seen in FIG. 9, numerals 302 to 306 represent three different solutions, each 
can be viewed as a set of voxels having a predetermined minimal connectivity value ; 
For an initial connectivity threshold value ti such that ti is lesser than Ci, C2 and C3, 
30 the solution set would be the voxels represented by numeral 302. As the connectivity 

11 i 

i 
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threshold value increases, the solution space shrinks. By setting the threshold to t 2 , 
such that t 2 is now greater than c 3 but still lesser than c, and C2, voxel v 3 . having a 
connectivity value c 3 lower than the threshold, is ho longer part of the solution set 
now represented by numeral 304. Further still, by setting t 3 such that t3 is greater 
5 than both 03 and c 2 but still lesser than d, voxel v 2 , having a connectivity value c 2 
lower than the threshold, is no longer part of the new solution set now represented by 
numeral 306. j 

1 
1 

FIGS. 10, 11 and 12 show the effect of the rising threshold value on the; 
three-dimensional images corresponding to solution sets 302, 304 and 306 
10 respectively. As will be noted, as the threshold is increased, the segmentation is; 
enhanced. j 



i 



The weighting of the connectedness with the distance function may be 
utilized with additional image enhancing techniques by optionally letting the user, 
using user interface 24, embed knowledge of the structure that he or she wishes to 
15 segment. 

Contrast table 

To improve the accuracy and speed of segmentation, a lookup table can be 
used to enhance the differences between the anatomical structures underj 
investigation and the rest of the anatomy. The lookup table maps or assigns contrast! 
20 values to certain densities, range of densities or areas. The segmentation process? 
will then operate on the image once it has been remapped using the contrast values; 
in the look up table. The connectivity expressed by Equation 6 will then be calculatec 
as follows: 

C x . = l-min^Jmax^,, [density" (P) -density" (s)| + <x- A(p.s)J Equation 7 

25 where density'(v) = lookup table [density(v)]. 

In FIG. 13 there is shown a flow chart that depicts the lookup table setting 
and remapping process steps. The sequences of steps performed is indicated by the 
sequence of blocks 232 to 240. In block 232. the process inputs data-set 28 for 

12 
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processing. At block 234 the user has the option to create, using user interface 24, a 
lookup table by inputting specific density values or by selecting a specific areas. At 
block 236, if that option is selected, the user inputs, using user interface 24, specific 
density values that are to be remapped to a predetermined density. Densities within 

i | 

5 the range selected are thus remapped to the predetermined value at block 240 and 
then processed for segmentation and display as shown above. 

Alternatively, at block 238, if that option is selected, the user selects, using 
user interface 24, specific areas of the image represented by data-set 28 whose 
voxels densities are to be remapped to a common value. Finally, at block 240, all 
10 voxels selected at block 238 have their density value remapped to the common valuej 
that typically may be zero (background). It should be noted that block 240 may be; 
modified to assign different values than zero if so desired. j 

There are several ways in which the algorithm can take advantage of this 
functionality, mainly in reducing the noise in the image and increasing the accuracy 

15 of the segmentation by eliminating densities that are not part of the anatomy underl 
investigation, i.e. outside a range of values of interest. For example, in a CTAj 
dataset, the liver does not contain any densities that are as high as the density ofj 
bone; hence the bone's density can be remapped to zero (background) and excluded! 
from the segmentation. Another advantage is in limiting user mistakes. If the user 

20 places a seed point in a region which is considered background, then the seed point 
will be ignored. For example, if the user is intent on segmenting the liver in a CTAJ 
dataset a seed point placed on the bone will not be considered. It should be noted 
that the remapping of densities through the use of the lookup table in the algorithm is 
optional. If a table is not used, the algorithm will operate on the original densityj 

25 values, I 

i j 

A significant benefit of the use of the lookup table is that it can integrate the 
segmentation with the visualization process, specifically using an opacity table 
typically used for the Volume Rendering. This approach brings several benefits as 

there are already several algorithm/workflow options for setting optimal values! 

i 

30 Moreover it orientates the segmentation to the view; 
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Using this technique, similar density in the image can be remapped as one, and this \ 
can improve the segmentation in some situations. 

5 This technique is very powerful when used with the distance function as the actual 
vessel to follow can contain several densities, which the contrast table (opacity) will 
remap as one. The seed point being inside the vessel will have the same intensity as 
well. So for a voxel inside the vessel equation became : 

TO C x =1-min P ( St v)a(maXpinP( 9 ,v)C A (P.s)))=> 1~(xmin P (&,y) A (v,s) (*) 
Since max p in p (3l v),(A (p,s)) = A (p,s) = number of steps from s to p. 

With (•) it is clear that a represents the length along the minimal path that makes the 
membership decrease by 1 and so it can be used to measure the length of the 
15 vessel. So in other terms if from voxel V to seed point S there are N difference in 
membership value, it means that the distance along the vessel is N/a 

Density range 

i 

To further improve the accuracy and speed of segmentation, a density range) 
20 can be used to limit the range of densities to be considered by the algorithm. The| 
segmentation process will then operate on the image once it has been remapped byj 
excluding all densities that are not in the selected range. The user may set th'et 
density range by either specifying the specific densities or, in a more interactive wayj 
by selecting a seed point and specifying predefined limits for display relative to the 
25 seed point, i.e. the number of densities to be considered above and below the seed 
point's density value. In FIG. 14 there is shown a flow chart that depicts the density 
range setting and remapping process steps. The sequences of steps performed is 
indicated by the sequence of blocks 252 to 264. In block 252 the process inputs dataj 
set 28 for processing. At block 254 the user has the option to set the range of 
30 densities to be excluded by the algorithm, using user interface 24, by way of a seed 
point or by inputting a specific density range. At block 256, if that option is selected , 

14 
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the user selects a seed point, using user interface 24, who's density value will 
become the center of a density range, the extent of that range is specified by the 
user, using user interface 24, at block 260. At block 258, if that option is selected, the 
user specifies the density range, using user interface 24, by setting the lower bound 
5 value of the range and then, at block 262, the upper bound. Finally, at block 264, all 

« 

voxels having a density outside the density range specified have their density value 
remapped to zero (background). It should be noted that block 240 may be modified to 
assign different values than zero if so desired. I 

Volume size 

10 To still further improve the accuracy and speed of segmentation, an 

expected number of data points can be set to limit the size of any solution $& 
generated by the algorithm. For example, for a 3-D image, the volume size of a 
structure (i.e. number of voxels) can be used to guide the segmentation. The volume 
size of the object can be measured simply by querying the histogram, as shown in 

15 FIG. 15, of the connectivity map and calculating the area under the curve for all the 
values from the threshold to the maximum connectivity value. Since there is a direct 
relationship between the threshold and the volume of the structure, the algorithm can 
automatically determine the optimal threshold to extract the structure with the 
specified volume by starting at a high value threshold, computing how many voxels 

20 there are that have a connectivity value higher than the threshold and lowering the 
threshold until the number of voxels with a connectivity value higher than the 
threshold corresponds to the expected volume size. 

In FIG. 16 there is shown a flow chart that depicts the automatic thresholi 
setting process steps. The sequences of steps performed is indicated by the 

25 sequence of blocks 272 to 282. In block 272 the process inputs data-set 28 for 
processing. At block 274 the user sets, using user interface 24, the expected volume 
of the structure under consideration and at block 276 the connectivity threshold. At 
block 278 the connectivity level of the voxels is computed, using the algorithm shown 
in FIG. 4, then in block 280 the volume is computed by calculating the number of 

30 voxels which have a connectivity level above the set threshold. Finally, at block 282, 

15 
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computed volume and expected volume are compared to see if they are equal, if the 
computed volume is bigger, then at block 272 the threshold is set to a higher value 
but if the computed volume is smaller, then at block 272 the block is set to a lower 
value. It should be noted that instead of comparing to see if the computed and 
5 expected volumes are equal, they could be compared to see if their difference is 
within a certain acceptable margin. 

i 

In FIG. 17 there is shown a flow chart that depicts the operation of thej 
program 30, for controlling the computer 20, incorporating the above-described! 
improvements. The sequence of steps performed by the program is indicated by the J 
10 sequence of blocks 502 to 522. In block 502 the program inputs a data-set 28 for 
processing. 

At block 504, the user has the option to set, using user interface 24, a 
contrast table to allow the elimination of unwanted structures and/or densities. 

At block 506, the user has the option to set, using still user interface 24, a 
15 density range in order to limit the range of densities ito be considered. 

At block 508, if the user has set any contrast table or density range, the 
program 30 remaps the data-set 28 in accordance with the set values. 

At block 510, the user sets, using still user interface 24, the path weight that 
will be used by block 514 for the computation of the connectivity values. 

20 At block 512, the user sets, using still user interface 24, the seed point or 

points that will be used by block 514 for the computation of the connectivity values. 

At block 514, the program 30 computes the connectivity values according to 
Equation 6 in accordance with the path weight value set at block 510. It should be 
noted that Equation 6 is performed on the modified [ 

25 data-set, meaning the output of block 508. 

At block 516, the user as the option to set, using still user interface 24, an 
expected volume in order to automatically compute the optimal threshold. j 
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At block 518, the user sets, using still user interface 24, the threshold 
representing the lowest connectivity value to be corisidered. It should be noted that if 
the user has set an expected volume at block 516, an optimal threshold value will 
have already been selected, though the user can still modify that value if so desired. 

At block 520, the program 30 uses display 26 to show the user the structure! 
associated with the selected threshold. 



At block 522, the user, analyzing display 26, evaluates if the desired 
structure is displayed, if not, the user may return to: block 518 to set a new threshold 
value to further expand or shrink the displayed structure. j 

10 Although the present invention has been described by way of a particulaij 

( i 

embodiment thereof, it should be noted that modifications may be applied to the 
present particular embodiment without departing i from the scope of the presen 
invention and remain within the scope of the appended claims. 
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